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CAMERA SENSOR IDENTinER 
VIA ETCHED FLAW 



BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION 

This invention relates generally to tracking images and identifying sensor of 
origin. More particularly, the present invention relates to a method and apparatus for 
camera sensor identification via an etched flaw. 

2. HISTORY OF THE PRIOR ART 

There has be an explosion in the number of digital imaging systems available to 
consumers as higher performance products are being offered at lower prices. Some of the 
more popular consumer applications include digital video, scanners, copiers, facsimile, 
and digital cameras. Efforts to develop more advanced digital cameras are fueled by the 
continued expansion of high performance personal computers in both homes and 
businesses. Today's computers have the data processing capabilities to manipulate and 
display the data of digital images. 

Digital camera manufacturers have been striving to improve the digital imaging 
system in a number of ways. Systems are being designed to yield improved digital image 
quality in an effort to match that of the conventional chemical film cameras. There are 
also efforts to reduce the power consumption required for battery-operated systems such 



DHJ/PL 



42390.P53I1 



as digital cameras. However, one area that is of interest for improvements is security and 
image tracking. 

Existing digital cameras provide for the attachment of data such as messages, 
5 captions, or dates to images. However, the data is generally user controlled and may be 
fraudulently modified. Similarly, other art such as the Advanced Photo System™ (APS) 
stores data related to film format or cassette information in a special recording layer in the 
film. For instance, some APS cameras record reprint information invisibly on the film's 
magnetic layer. But these methods do not provide for storing an identifier that could be 
10 used in identifying the sensor from which the image came from. Users may be interested 
in the tracking of images taken with a particular sensor, especially in security applications - 
or manufacturing. Currently, no such identifier is currently available. 

Hence it would therefore be desirable to have a method and apparatus for tracking 
IS images and identifying its sensor of origin. 
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SUMMARY OF THE INVENTION 

The present invention introduces a method and apparatus for camera sensor 
identifier via an etched flaw. The method of the present invention first fabricates a solid- 
state image sensor. The image sensor comprises of a plurality of transistors. Then a 
5 subset of said transistors are modified to create an identifier. Modification may entail the 
use of a laser or electron beam to alter a subset of said transistors. 

Other objects, features, and advantages of the present invention will be apparent 
from the accompanying drawings and from the detailed description that follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example and not limitations in the 
figures of the accompanying drawings in which like references indicate similar elements, 
and in which: 

5 Figure 1 is a block diagram illustrating a camera that may utilize a camera sensor 

having an etched identifier; 

Figure 2 is an illustrative block diagram of an embodiment of a computer system 
operating in combination with a image capturing device; 

Figure 3 is a block diagram illustrating a computer system which may utilize the 
10 present invention; 

Figure 4 is an illustrative block diagram of one embodiment of a camera sensor 
including an etched identifier; 

Figure 5a is a flow chart illustrating the steps taken in one embodiment of 
creating a sensor with an etched identifier; 
IS Figure Sb is a flow chart illustrating the steps taken in another embodiment of 

creating a sensor with an etched identifier; 

Figure 6a is a flow chart illustrating the steps taken in one embodiment of using a 
camera sensor to capture an image; 

Figure 6b is a flow chart illustrating the steps taken in another embodiment of 
20 using a camera sensor to capture an image; 

Figure 7a is a flow chart illustrating the steps taken in one embodiment of 
processing an identifier in an image before the image is displayed; and 
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Figure 7b is a block diagram illustrating the steps taken in another embodiment 
of processing an identifier in an image before the image is displayed. 
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be used to etch some identifier or serial number on an IC after manufacturing. 

Certain users may be interested in the tracking of images taken with a particular 
sensor, especially in security applications or manufacturing operations. But none of these 
methods provide for associating an identifier that could be used in identifying the specific 
sensor or camera from which the image came from. Furthermore, the identifier of the 
present invention may be a unique identifier. Currently, no such identifier is available for 
camera sensors. In addition, a software driver or client application, such as an image 
viewer, could exercise control of the identifier and images without user intervention. 
This invention may be especially valuable for security applications. Therefore, a method 
of tracking images and identifying the specific sensor or camera from which an image 
originated would be desirable. 

Anyone that made or used an image sensor may be interested in this kind of 
technology. This identifier is similar to a watermark, but for images. It could be used for 
authenticating images and image management. 

One possible application of the present invention would be for lot control in a 
manufacturing process. For instance, identifiers in sensors would mark each lot of 
wafers. If a certain number of integrated circuits had bad characteristics after production, 
a user could tell what lot the material came from in manufacturing. 
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Similarly, in the case of security applications, a user could know that a particular 
series of images were taken from a particular camera since the identifier could not be 
tampered with. In another instance, it would be possible to say that a certain image came 
from camera XYZ, which is in possession of person A, so person A must have taken the 
images. The sensor could be implemented within a camera such as a digital camera or a 
video camera. A secure identifier may also be used to prevent an image from being 
fraudulently altered without detection. 

This invention places an identifier on a solid-state image sensor, such as a Metal- 
Oxide Semiconductor (MOS), CCD, or CMOS sensor image sensor, by intentionally 
creating bad or "damaged" image cells (pixels) on the sensor. A sensor is composed of 
an array with a number of different cells, each of which could form a pixel in the final 
image. The image cells or elements may be built from transistor devices such as p-n 
junction photodiodes, phototransistors, photoconductors, photovoltaic cells, or other 
similar semiconductor elements. The damaged pixels are also known as the etched fiaw. 
These pixels would be "damaged" in known locations. This allows a software driver to 
fmd the damaged cells in a image, read and assemble the identifier, and fix up the bad 
cells in the image before it is transferred to a client. 

The most difficult aspect of this invention is probably how to introduce the 
damaged cells onto the sensor. The damaged cells could be created in a number of ways. 
The method of the preferred embodiment is to use an electron beam or laser to damage 
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size 640x480, the sensor might have a size of 640x481 if this invention were added. The 
extra row of 640 cells could be used to store an identifier on the sensor. A laser would be 
used to destroy certain cells on the sensor. Since 640 bits are probably more than 
required for an identifier, other information may also be placed in those bits. 

5 Alternatively, an extra column may be created to store an identifier. So instead of having 
a sensor of size 640x480, a sensor of size 641x480 may be created. However, the method 
using an extra row provides more cells (i.e. 640 cells in an extra row versus 480 cells in 
an extra column) for storing an identifier. Furthermore, if a security scheme is used in 
image capture, the extra cells available in the extra row method may allow for a more 

10 robust security scheme. 

The software portion of the driver hooks to the image capture hardware and 
computer system. The driver actually receives the data from the hardware via a buffer or 
in multiple packets in a stream. A number of packets would form one image frame. Each 

IS image firame would have an identifier embedded in the data either scattered in the image 
or located in one row or column of the image. The software locate the identifier would 
go to those locations and extract the identifier. In the example of an extra row, the driver 
takes the packets and assembles it into an image frame with an extra row. The extra row 
can be shipped off to the client, or read and stored. The client may be configured to save 

20 the identifier and not display it. The driver could also take the extra row, assemble the 
identifier out of it, and store the identifier along with the image frame as a number, 
possibly in some other location such as the image franie header. Therefore, the identifier 
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data would be present and accessible, but not within the image itself. This way, the client 
application would not have to deal with an extra row of pixels, especially if the client 
does not know how to handle it. 

5 Alternatively, the software driver could either not ship the last row to the client 

because the client may be unaware of the last row and is not capable of handling it. If the 
driver is designed such that the last row is not normally shipped to the client, the client 
could alternatively request the last row if it is not normally shipped to it. The ideal 
situation would be for the client to get the extra row of pixels in the image, but have the 

10 option of whether to display it or not. But the identifier would usually be saved or stored 
with the image. Hence the identifier data would always be attached to the image and 
would act as the identifier of what sensor the image came from. This would allow all 
images captured with a particular sensor to have the sensor identifier embedded right in 
the image. There may also be encryption techniques that would allow tampering with the 

IS identifier to be detected. Hence there may be security applications where this kind of 
embedded identifier would be very valuable. 

The image with the identifier data could possibly have problems if viewed with a 
normal JPEG or GIF viewer that did recognize the format. In the case of the extra row, 
20 the extra row could possibly appear as garbage or gibberish to the client. An image 

viewer or client could be configured not to display the extra row or to save the identifier 
off from the regular image data. This invention may introduce different image sizes than 
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the implmenttt or developer of the driver. 
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several transistors for color. The more pixels there are in an image, the better its 
resolution. 

The transistors in a CCD 110 generate a continuous, analog electrical signal that 
5 goes to an analog-to-digital converter (ADC) 115. The ADC 115 is a chip that that 
translates the varying analog signal to a digital format, which consists of a stream of l^s 
and O's. Here, the ADC 115 converts the analog signals it receives from the CCD 110 to 
digital image signals. The ADC 115 sends the digital information to a digital signal 
processor (DSP) 120 that has been programmed specifically to manipulate photographic 
10 images. The DSP 120 adjusts the contrast and detail in the image, compresses the data 
that makes up the image so it takes less storage space, and sends the data to the camera's 
storage medium 125. 

The image is temporarily stored on a hard drive or in Random Access Memory 
IS (RAM) built into the camera body, and from there it can be transferred to a PC*$ 

permanent storage through a serial or SCSI cable. Or the image may be saved to a special 
mini-floppy drive or a PC Card plugged into the camera 100. Portable types of storage 
like a floppy or PC Card can be removed from the camera and inserted into a matching 
connection on a PC, where its data can be copied to a hard drive or writable CD-ROM. 
20 Some cameras that create very large files may be cabled to a PC while a photo is being 
shot, instantly transmitting the image directly to the computer. 
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Image Capturing With A Computer 

Referring now to Figure 2, an illustrative block diagram embodiment of an image 
capturing device 215 employing the present invention and operating in association with a 

5 computer system 200 is illustrated. The computer system 200 comprises a display 

monitor 205 having a PC platform 210 containing memory, processing hardware and the 
like. An image capturing device 215 such as a video camera, digital camera, and the like, 
is illustrated separate from the display monitor 205. The capturing device may be 
implemented internally within the casing of the display monitor 205 or mounted onto the 

10 display monitor 205 as shown. As the capturing device 215 captures a data clip of 

desired data such as the physical characteristics of a computer user 220, it uransmits the 
captured data clip to the PC platform 210 via a conununication line 225. 

The conmiunication line 225 may be represented as an electrical or fiber optic 
IS cable, a wireless communication line, and the like. Since the conmiunication line 225 
may be publicly accessible, jeopardizing the integrity of the captured data clip, a secure 
data capture device 230 may be employed within the capturing device 215. The secure 
data capture device 230 could capture a data clip and securely transmits the captured data 
clip to the PC platform 210 by digitally signing each captured data frame or the entire 
20 data clip. 



DHJ/PL 



15- 



42390.P53II 



In one embodiment, the capturing device 215 may be coupled to an external 
computer 200 via a high-speed serial bus that enables the capturing device to transmit 
digital image signals to the computer without interim storage in an on-board buffer. For 
instance, a digital camera captures a still image and transfers the still image from the 

5 digital camera to an associated computer system. Transfer of the captured still image is 
performed by camera device driver and bus interface software executing on the computer 
system. In one embodiment, the digital camera may be tethered to the computer system 
by a Universal Serial Bus (USB). The camera device driver and bus interface software 
could control access and usage of the USB. The computer may also perform various 

10 imaging routines on the raw digital signals from the capturing device in real time, 
eliminating a need for an on-board processor in the capturing device. 

It is contemplated that other embodiments of the image capturing device 215 may 
exist. For example, the capturing device may include various types of internal storage or 
IS data manipulation capabilities. In that case, the data capture device 215 may not require 
the conununication line 225 to establish an electrical connection with the computer 
system 200. 

20 A Computer System Application 

Referring now to Figure 3, there is a block diagram illustrating a computer system 
300 which may utilize the present invention. The system 300 includes a central processor 
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Figure 6a is a flow chart illustrating the steps taken in one embodiment of using a 
camera sensor that was created from the method of Fig. 5a to capture an image. First, a 
user uses a camera with a sensor to take a picture at step 600. Then at step 605, the 
sensor captures the image/sensor data including identifier flaws located in the extra pixel 
row. At step 610, the image data is sent from the camera to a software driver on a 
computer. The software driver may be designed to process image data, decode the sensor 

identifier firom the data, interpolate pixel values, etc. In this embodiment of the present 

^ ... 

invention, the software driver may be distributed to the computer via a network or loaded 
from a disk drive. Although the above example describes the distribution of a software 
driver via a network, software drivers may be distributed by way of other computer 
readable mediums. For instance, a computer program may be distributed through a 
computer readable medium such as a floppy disk, a CD ROM, a carrier wave, or even a 
transmission over the internet. 

The image data is processed and the identifier in the extra pixel row are stored 
away at step 615. The identifier may either be appended to the end of the image data or 
stored in the image frame header. The identifier may also be stored separately from the 
image data, but there may be issues in associating the correct identifier with the proper 
image afterwards. Now when the user decides to view the image, the image data is 
brought up in a driver client such as an imaging application at step 620. There may be 
two options available to the user. First, a user may save the image data, including the 
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identifier stored in the extra row or image frame header at step 625. Then at step 630, the 
data would be sent to a hard disk or some other similar type of storage device. On the 
other hand, a user may choose to view the image via a display at step 635. The identifier 
data in the extra row or header is masked out so that only the image is sent to a display at 
5 step 640. Alternatively, a user may wish to view the associated identifier, in which case 
all of the image data and its identifier is sent to a display. 

Figure 7a is a fiow chart illustrating the steps taken in one embodiment of 
processing an identifier in an image before the image is displayed. In this embodiment, 

10 the camera used to generate the images used a sensor with an extra pixel row as described 
in Fig. 5a. At step 702, a video frame is received from the camera and placed in a video 
frame buffer for processing by a software driver. If the image was taken at an earlier 
time, it may be coming from some storage device instead of a camera. Then at step 704, 
the software driver as described in Fig. 6a extracts the sensor identifier from the extra 

IS pixel row in the video frame. The sensor identifier is then placed into a video frame 

header at step 706. The video fi'ame comprising of the normal viewable area of the image 
is copied at step 708 from the video frame buffer into a client buffer. The client in this 
case may be an image application or some similar driver client. At step 710, the client 
buffer is sent to the client with the sensor identifier in a image frame header associated 

20 with the image data. Now if the user wants to view just the image, the data in the client 
buffer may be displayed on a video monitor. Whether the associated sensor identifier is 
displayed or not may be at the user's discretion. Alternatively, the image data and the 
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image frame header with the identifier may be saved to a long term storage device like a 
hard disk drive or floppy disk. Also depending on the application, a user may store the 
sensor identifier in other mediums other than the image frame header. 

5 

Another Embodiment 

Figures 5b, 6b, and 7b will be used together in describing a second embodiment 
of the present invention. In this embodiment, the etched identifier is distributed among 
different pixels of the camera sensor. 

10 

Figure 5b is a flow chart illustrating the steps taken in another embodiment of 
creating a sensor with an etched identification. As in Figure 5a, a sensor is first 
manufactured at step 552. However, in the current embodiment of the method, the 
camera sensor would not contain an extra row of pixels. Hence in our example, the 
IS sensor would only have a size of 640x480. At step 554, identifier flaws are distributed 
among pixels in the sensor. This step entails modifying or damaging certain pixels in 
known locations within the sensor. This step may be performed with an electron beam or 
laser. Then at step 556, the modified sensor is mounted into a camera. 

20 Figure 6b is a flow chart illustrating the steps taken in a second embodiment of 

using a camera sensor that was created from the method of Fig. 5b to capture an image. 
First, a user uses a camera with a etched sensor to take a picture at step 650. Then at step 
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655, the sensor captures the image/sensor data including the identifier flaws that are 
distributed within the image. At step 660, the image data is sent from the camera to a 
software driver. The image data is processed and the "damaged" pixels are "fixed" at 
step 665. The identifier that was stored in the "damaged" pixels within the image are 
now appended to either an extra row at the end of the image data or stored in the image 
frame header. When the user decides to view the image, the image data is brought up' in a 
driver client such as an imaging application at step 670. There may be two options 
available to the user. First, a user may save the image data, including the identifier stored 
in the extra row or image frame header at step 675. Then at step 680, the data would be 
sent to a hard disk or some other similar type of storage device. On the other hand, the 
user may choose to view the image via a display at step 685. The identifier data in the 
extra row or header is masked out and only the image is sent to a display at step 690. 
Alternatively, a user may wish to view the associated identifier, in which case all of the 
image data and its identifier is sent to a display. 

Figure 7b is a block diagram illustrating the steps taken in another embodiment 
of processing an identifier in an image before the image is displayed. In this 
embodiment, the camera used to generate the images used a sensor with known 
"damaged" pixels dispersed within the sensor as described in Fig. 5b. At step 752, a 
video frame is received from the camera and placed in a video frame buffer for 
processing by a software driver. If the image was taken at an earlier time, it may be 
coming from some storage device instead of a camera. Then at step 754, the software 
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driver as described in Fig. 6b extracts the sensor identifier from the damaged pixels 
dispersed with the sensor. The sensor identifier is then placed into a video frame header 
at step 756. The video frame comprising of the normal viewable area of the image is then 
copied from the video frame buffer into a client buffer. The client may be an image 

5 application or some similar driver client. But there are still damaged pixels present in the 
image. At step 758, the software driver repairs the damaged pixels in the video frame: In 
this embodiment of the present invention, the damaged pixels are repaired by 
interpolating the value of each damaged pixel based on the values of its surrounding 
pixels and filling in the value of each damaged pixel in the client buffer. At step 760, The 

10 client buffer is sent to the client with the sensor identifier in a image frame header 

associated with the image data. Now if the user wants to view just the image, the data in 
the client buffer may be displayed on a video monitor. Whether the associated sensor 
identifier is displayed or not may be at the user's discretion. Alternatively, the image data 
and the image frame header with the identifier may be saved to a long term storage device 

IS like a hard disk drive or floppy disk. Also depending on the application, a user may store 
the sensor identifier in other mediums other than the image frame header. 
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